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5 Cross Reference to Related Applications 

The following copending applications, assigned to the assignee of 
the present invention, contain common disclosure and are 
incorporated herein by reference in their entireties: 

"High Speed Software Driven Emulator Comprised of a Plurality of 
10 Emulation Processors with Improved Board-to-Board Interconnection 

C3 Cable Length Identification System/' Serial No. , filed 

, (Attorney Docket No. POU9-2000-0045-US1 ) . 
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=2 Emulation Processors with an Improved Maintenance- Bus that 

15 Streams Data at High Speed/' Serial No. , filed 

C3 , (Attorney Docket No. POU9-2000-0046-US1) . 



^ "High Speed Software Driven Emulator Comprised of' a Plurality of 
£3 Emulation Processors with a Method to Allow Memory Read/Writes 

Without Interrupting the Emulation/' Serial No. , filed 

20 , (Attorney Docket No. POU9-2000-0048-US1) . 

"High Speed Software Driven Emulator Comprised of a Plurality of 
Emulation Processors with Improved Multiplexed Data Memory/' 

Serial No. , filed , (Attorney Docket No. 

POU9-1999-0183-US1) . 
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Field of the Invention: 

This invention relates to a software driven emulator comprised of 
a large number of single bit processors operating in parallel to 
execute, at high speed, an emulation of a complex processor, and 
5 more particularly, to a system and method for high-speed 
streaming of bulk read and write operations from and to the 
synchronous DRAM module memories in order to support a 
simulation-accelerate mode of operation. 

Trademarks : 

10 S/390 and IBM are registered trademarks of International Business 

-f Machines Corporation, Armonk, New York, U.S.A. and Lotus is a 

w 

in registered trademark of its subsidiary Lotus Development 

^ JJ Corporation, an independent subsidiary of International Business 

Lf| Machines Corporation, Armonk, NY. Other names may be registered 

J? trademarks or product names of International Business Machines 

5 Corporation or other companies. 

h ~- 

%J 

C3 Background: 

£3 

£3 The usefulness of software driven emulators has increased 
enormously with growth in the complexity of integrated circuits. 

20 Basically, an emulation engine operates to mimic the logical 
design of a set of one or more integrated circuit chips. The 
emulation of these chips in terms of their logical design is 
highly desirable for several reasons. The utilization of 
emulation engines has also grown up with and around the 

25 corresponding utilization of design automation tools for the 
construction and design of integrated circuit chip devices. In 
particular, as part of the input for the design automation 
process, logic descriptions of the desired circuit chip functions 
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are provided. The existence of such software tools for 
processing these descriptions in the design process is well 
suited to the utilization of emulation engines which are 
electrically configured to duplicate the same logic function that 
5 is provided by a design automation tool. 

Utilization of emulation devices permits testing and verification 
via electrical circuits of logic designs before these designs are 
committed to a socalled "silicon foundry" for manufacture. The 
input to such foundries is the functional logic description 

10 required for the chip and its output is initially a set of 
photolithographic masks which are then used in the manufacture of 
the desired electrical circuit chip device. Verifying that logic 

*Z designs are correct in the early stage of chip manufacturing 

in eliminates the need for costly and timeconsuming second passes 

t$ through a silicon foundry. 

TT Another advantage of emulation systems is that they provide a 

f — 

s device that makes possible the early validation of software meant 
^ to operate the emulated chips. Thus, software can be designed, 
C3 evaluated and tested well before the time when actual circuit 
M chips become available. Additionally, emulation systems can also 
□ operate as simulator-accelerator devices thus providing a 
highspeed simulation platform. 

Emulation engines of the type contemplated by this invention 
contain an interconnected array of emulation processors (EP) . 

25 Each emulation processor (hereinafter, also sometimes simply 
referred to as "processor") can be programmed to evaluate logic 
function (for example, AND, OR, XOR, NOT, NOR, NAND, etc.). The 
program driven processors operate together as an interconnected 
unit, emulate the entire desired logic design. However, as 

30 integrated circuit designs grow in size, more emulation 
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processors are required to accomplish the emulation task. An aim, 
therefore, is to increase the capacity of emulation engines in 
order to meet the increasingly difficult task of emulating more 
and more complex circuits and logic functions by increasing the 
5 number of emulation processors in each of its modules. 

For purposes of better understanding the structure and operation 
of emulation devices generally, and this invention particularly, 
United States Patent No. 5,551,013 and patent application Serial 
No. 09/373,125 filed August 12, 1999, both of which are assigned 
10 to the assignee of this application, are hereby incorporated 
herein by reference. 

*i Patent No. 5,551,013 shows an emulation chip, called a module 

Efl here, having multiple (e.g. 64) processors. All processors 
within the module are identical. The sequencer and the 

if! 

i r 5 interconnection network occurs only once in a module. The 

77 control stores hold a program created by an emulation compiler 

s for a specified processor. The stacks hold data and inputs 

)t previously generated and are addressed by fields in a 

C3 corresponding control word to locate the bits for input to the 

S S3. 

2$ logic element. During each step of the sequencer an emulation 

u processor emulates a logic function according to the emulation 
program. A data flow control interprets the current control word 
to route and latch data within the processor. The node-bit-out 
signal from a specified processor is presented to the 

25 interconnection network where it is distributed to each of the 
multiplexors (one for each processor) of the module. The node 
address field in the control word allows a specified processor to 
select for its node-bit-in signal the node-bit-out signal from 
any of the processors within its module. The node bit is stored 

30 in the input stack on every step. During any operation the 
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node-bit-out signal of a specified processor may be accessed by 
none, one, or all of the processors within the module. 

Data routing within each processor's data flow and through the 
interconnection network occurs independently of and overlaps the 
5 execution of the logic emulation function in each processor. 
Each control store stores control words executed sequentially 
under control of the sequencer and program steps in the 
associated module. Each revolution of the sequencer causes the 
step value to advance from zero to a predetermined maximum value 

10 and corresponds to one target clock cycle for the emulated 
design. A control word in the control store is simultaneously 
selected during each step of the sequencer. A logic function 

-f operation is defined by each control word. 

Cn 

I F: 

L: Each of these emulation processors has an execution unit for 
13. processing multiple types of logic gate functions. Each 
r? emulation processor switches from a specified one logic gate 
s function to a next logic gate function in a switched-emulation 
^ sequence of different gate functions. The switched-emulation 
S3 sequence of each of the processors thus can emulate a subset of 
IS gates in a hardware arrangement in which gates are of any type 
C3 that the emulation processors functionally represent for a 
sequence of clock cycles. The processors are coupled by a like 
number of multiplexors having outputs respectively connected to 
the emulation processors of a module and having inputs 
25 respectively connected to each of the other emulation processors. 
The bus connected to the multiplexors enables an output from any 
emulation processor to be transferred to an input of any other of 
the emulation processors. In accordance with the teachings of 
the pending application, the basic design of the 5,551,013 patent 
30 is improved by interconnecting processors into clusters. With 
interconnected clusters, the evaluation phases can be cascaded 
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and all processors in a cluster perform the setup and storing of 
results in parallel- This setup includes routing of the data 
through multiple evaluation units for the evaluation phase. For 
most efficient operation, the input stack and data stack of each 
5 processor must be stored in shared memory within each cluster. 
Then, all processors perform the storage phase, again in 
parallel. The net result is multiple cascaded evaluations 
performed in a single emulation step. Every processor in a 
cluster can access the input and data stacks of every other 
10 processor in the cluster and less space on each module chip for 
the functions that support the processor operation, particularly 
the memory functions. 

'^i As will be appreciated by those skilled in the art, emulators of 

Eil the type described above have evolved to perform not only in a 

JS traditional emulation mode but also in a simulation-accelerate 

IH mode. In this simulation-accelerate mode, there is a requirement 

12 to upload and download large quantities of data from the system 

s SDRAMs for the data capture function of the simulation-accelerate 
operating mode. 

i I 

■3 Kt 

£fs 

2K) In the prior art emulators, such as the ET 3.5 and ET 3.7 
^3 emulators, the protocol for writing data to and reading data from 
SDRAMS requires a hand shake protocol. A word is transferred from 
or to the SDRAM only in response to a "done" signal from the 
memory signaling that the previous transfer operation has been 
25 completed. The "done" signal is required in these prior art 
systems to account for the case where the previous transfer 
operation was delayed by a memory refresh operation. Such prior 
art protocols slow the bulk transfer of data to and from an SDRAM 
memory. 

30 Summary of the Invention: 
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An object of this invention is the provision of a system and 
method for rapidly transferring large quantities of data to and 
from SDRAM memories in an emulator in order to support 
simulation-acceleration operating mode. 

5 Briefly, this invention contemplates the provision of a system 
and method for bulk transfer to and from the SRAMs in which a 
starting memory address is latched and is then incremented every 
clock cycle to generate a new memory address, as described more 

extensively in copending application Serial No. , filed 

10 (POU9-2000-0048-US1) and assigned to the assignee of this 

application. The addresses are decoded and memory requests are 
^ pipelined to the SRAM memory, one every clock cycle. When the 
Cn memory controller detects transfer of the boundary of a 
predetermined number of clock cycles or words (e.g. 64 words or 
W5 four clock cycles) the burst mode of data transfer is stopped and 
12 the memory controller waits for a "done" signal before resuming 
s _ another cycle of the burst transfer mode. The memory controller 
on detecting a request on this address boundary first does a 
memory refresh followed by a requested operation; e.g. a 
§P continuation of the transfer operation. 

f ~! 

Brief Description of the Drawings: 

The foregoing and other features and advantages of the invention 
will be described with reference to the accompanying drawings. 
In the drawings, like reference numbers generally indicate 
25 identical, functionally similar, and/or structurally similar 
elements. Also in the figures, the left most digit of each 
reference number corresponds to the figure in which the reference 
number is first used. 
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Figure 1 is a high level block diagram of two of 64 modules on an 
emulator board of the type to which this invention is applicable. 

Figure 2 is a flow diagram of the method steps of this invention. 

Detailed Description of the Invention: 

5 Referring now to Figure 1, each board 14 of the emulation 
processor in this exemplary embodiment has sixty-four modules 
12, two of which are illustrated in Figure 1. Each module has an 
E4 chip 16, which includes sixty-four single-bit processors. Each 
module has a main memory 18 comprised of two SDRAMs and a single 
10 SSRAM. These memories communicate internally with the E4 chip 16 
on the module to which these memories are attached, via an 
EfS internal module bus. A maintenance bus connects these module 
main memories to other modules on the same board, to modules on 
y] other boards, and to a work station 26, which serves the entire 
15 emulation engine. There is one memory controller 22 for each 
s board. The memory controller 22 interfaces the reading and 
H writing of data from and into the SDRAMs and SSRAMs in a data 
C3 capture mode of operation in which bulk transfers of data between 
the work station and the SDRAMs and SSRAMs are carried out via 
fSb the maintenance bus. 

For bulk transfers in accordance with the teachings of this 
invention, a latch is set by one of the ET4 control stores to 
inhibit further transfers between the ET4 processor chip and the 
SDRAMs on the module, as described in detail in copending 

25 application serial number , (POU9-2000-0048-US1) . The 

memory controller 22 includes incrementing logic into which a 
starting SDRAM address is inserted when the emulator is to 
perform a bulk data transfer operation. This memory address in 
incremented by "1" in response to each clock signal. Similarly, 
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with the latch set, the memory controller makes a memory request 
(i.e. read or write) to the incremented address in response every 
clock cycle. Periodically, the memory controller, after making a 
memory request, waits for the memory "done" return before making 
5 the next memory request. This periodic pause in the streamed bulk 
memory transfer allows time for the SDRAM refresh cycle, the 
completion of which is signaled by the "done" return signal. As 
will be appreciated by those skilled in the art, the minimum 
frequency at which there is a pause in the bulk streaming 
10 operation is a function of the frequency at which the SDRAM must 
be refreshed. In one specific example, an emulator of the type 
described herein uses commercially available SRAMs, has a clock 
cycle of 90 ns, and transfers data to and from the SDRAM on each 
*i m clock cycle as a sixteen-bit word for each memory address. The 
DT5 memory controller detects each 64 word boundary and stops the 
burst mode of data transfer while the controller waits for a 
,f\ "done" return from the memory in order to resume the burst mode. 
2 Upon detecting the 64 word boundary, the memory controller 
initiates a refresh cycle. 

J 

UO Referring now to Figure 2 of the drawings, in a bulk data 
i» transfer to the module memories, a latch is set (block 30) and a 
13 starting address is entered into a register of the memory 
controller (block 32) . A sixteen bit data word is transferred 
each clock cycle (block 34) the address is incremented (block 36) 
25 and another word is transferred to or from this incremented 
address on the next clock cycle (block 37). After a 
predetermined number of clock cycles or on a predetermined word 
boundary (e.g. on each 64 word boundary) (block 38) the bulk 
transfer is halted while the memory controller waits for a "done" 
30 return (block 40) . When the "done" (block 39) signal is 
returned, the controller resumes the streaming mode of operation, 
which continues until the next 64 word boundary is detected. 
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While the preferred embodiment to the invention has been 
described, it will be understood that those skilled in the art, 
both now and in the future, may make various improvements and 
enhancements which fall within the scope of the claims which 
follow. These claims should be construed to maintain the proper 
protection for the invention first described. 
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